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QOS TESTING OF A HARDWARE MODULE OR A 

SOFTWARE CLIENT 

TECHNICAL FIELD 

This invention relates to testing the Quality of Service (QoS) of a hardware module or 
a software client in a Voice-over-IP (VoIP) network path. 

BACKGROUND 

Voice-over-IP (VoIP) is a technique for delivering voice information over a network 
that employs the Internet Protocol (IP). The network, called a VoIP network, transmits voice 
information digitally in the form of voice packets. The VoIP network is different from a 
public-switched telephone network (PSTN), which transmits voice signals as a stream of 
analog signals. Protocols used by the PSTN generally include IXC (Interchange Carrier), 
LEC (Local Exchange Carrier), and C-LEC (Competitive Local Exchange Carrier), which 
transmit analog voice signals in a manner different from the IP. 

Although a VoIP network is different from a PSTN in many aspects, a phone call that 
originates from a PSTN can be sent over the VoIP network to a computer. Conversely, voice 
packets originating from the Internet can also be sent over the VoIP to reach a telephone on a 
PSTN. For example, an Internet Telephony Service Provider (ITSP) network is a VoIP 
network. The ITSP network is built on the physical infrastructure of the Internet, and further 
includes gateways to perform appropriate conversions for transmitting calls between a PSTN 
and the Internet. The gateway includes conversion circuits for performing analog-to-digital 
and digital-to-analog conversions, as well as appropriate protocol conversions. 

For voice packets received from the Internet, the gateway converts them into analog 
signals, and sends the analog signals to the PSTN. The gateway also converts analog signals 
coming from the PSTN into voice packets. The gateway performs the conversions in both 
directions at the same time, allowing a full-duplex (two-way) conversation to take place 
between users connected to either the Internet or the PSTN. 

Compared to transmissions of data packets, voice transmissions are more susceptible 
to delays and variations in the delays. The delay variations, also called jitters, can greatly 
distort voice signals and render them unrecognizable to a user. Therefore, maintaining a 
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Quality of Service (QoS) acceptable to a user is an important issue in voice transmissions. 
Furthermore, because the IP is a "best effort" protocol that generally does not guarantee QoS, 
there is no assurance of the quality of voice transmissions over a VoIP network. Some VoIP 
networks therefore use an improved version of the IP, called Real-Time Protocol (RTP), to 
5 transmit voice packets to ensure QoS and timely delivery of the voice packets. RTP provides 
end-to-end delivery services of real-time audio and video. 

Quality of voice transmissions can be determined using conventional measurements 
for data transmissions, such as distortions, packet loss, and signal-to-noise ratio. However, 
characteristics of voice transmissions are different from those of data transmissions in many 
10 aspects. One of the most distinctive aspects of voice transmissions is the subjectivity of 

voice quality. Standards have been developed to measure the quality of voice transmissions 
3 from the perspective of a listener. The standards include Perceptual Speech Quality 
l[j Measurement (PSQM) and Perceptual Analysis-Measurement System (PAMS). 
[ J PSQM is an ITU standard that defines an algorithm for estimating the subjective 

;=|5 quality of voice-band speech codecs (coder-decoder). PSQM is an advanced version of MOS 
y (Mean Opinion Score) algorithm, which has been widely used as a subjective means to rate 
p vocoders (voice coder). Scores produced by the PSQM algorithm range from a scale of 1 
g (ideal) to 5 (poor). The PSQM scores can be converted to MOS scores by a standard 
|[= formula. 

IT ~3 

\ 20 The PSQM algorithm measures distortions of a speech signal when transmitted 

through various codecs and transmission media. It can effectively measure voice quality on 
IP networks and wireless networks. Unlike measurement of signal-to-noise ratios, the PSQM 
algorithm measures distortions in an internal psycho-acoustic domain to mimic the sound 
perception of people (e.g., phone users) in real-life situations, so that the measured 

25 distortions can be correlated with human perceptions. The PSQM algorithm converts signals 
in a physical domain into the perceptually meaningful psycho-acoustic domain through a 
series of nonlinear processes. The processes generally include time-frequency mapping, 
frequency warping, intensity warping, loudness scaling, asymmetric masking, cognitive 
modeling, and so forth. 

30 Another important standard for measuring clarity of vo ice signals as perceived by a 

human is Perceptual Analysis-Measurement System (PAMS). The PAMS uses a perceptual 
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model similar to that of PSQM to provide a repeatable, objective means for measuring 
perceived voice quality. The PAMS uses an effective signal processing model to produce a 
number of types of scores. The PAMS provides a "listening-quality" and a "listening-effort 11 
score, both of which can be converted to MOS scores and are on the same l-to-5 scale. 
5 Voice quality on an IP network can be determined using the above standards together 

with the conventional measurements for data transmissions. Deterioration of voice quality is 
often an indicator of a problem in the network. Frequently, the problem in the network is in a 
hardware module or a software client along a transmission path of the voice signals. 

SUMMARY 

10 The invention relates to testing the Quality of Service (QoS) of a component (e.g., a 

^ hardware module or a software client) in a Vbice-over-IP (VoIP) network path. In a general 

CO aspect of the invention, a method of testing a component in a VoIP network sending a digital 

a y 

j n audio file through the component to a destination; recording the digital audio file at the 

destination; and measuring characteristics of the recording to analyze the component. 
H5 Embodiments of this aspect of the invention may include one or more of the follow 

f features. 

J!J The method further includes polling the component for status information. The 

iff method repeats sending, and recording, or sending, recording, and measuring for a 
H predetermined number of times. 

20 The method also includes generating a call history of the component based on the 

status information, or the measuring of the recording. 

In another aspect of the invention, a system for testing a component on a voice-over- 
IP network includes a source node, a path, and an analyzer. The path connects the source 
node through a component to a destination node. The analyzer, being connected to the 

25 destination node, measures characteristics of a digital audio file received by the destination 
node. 

Embodiments of this aspect of the invention may include one or more of the follow 
features. 

The digital audio file is contained in a digital audio store. The digital audio file is a 
30 WAV file. The network further includes a test tool accessible by the source node to poll the 



3 



component for status information. 

In another aspect of the invention, a computer program product residing on a 
computer readable medium comprises instructions that cause the computer to: record a digital 
audio file received at a destination, the digital audio file being sent through a component; and 
measure characteristics of the recording to analyze the component. 

In yet another aspect of the invention, a computer program product residing on a 
computer readable medium comprises instructions that cause the computer to: send a digital 
audio file to a destination through a component; and poll the component for status 
information. 

The invention advantageously provides an efficient approach for testing a specific 
hardware device or a software client on a VoIP network. It also provides a means for 
performing QoS testing in a VoIP network path using a PC client and a test tool. 

The details of one or more embodiments of the invention are set forth in the accompa- 
nying drawings and the description below. Other features, objects, and advantages of the 
invention will be apparent from the description and drawings, and from the claims. 

DESCRIPTION OF DRAWINGS 
FIG. 1 is a system diagram of a Voice-over-IP network; 
FIG. 2 illustrates a set-up for a test for detecting problems on the network; and 
FIG. 3 illustrates a process of the test of FIG. 2. 
Like reference symbols in the various drawings indicate like elements. 

DETAILED DESCRD7TION 

Referring to FIG. 1, a Voice-over-Internet Protocol (VoIP) network 10 is connected to 
a communication network 1 1 (e.g., the Internet) and a local PSTN 12a, a regional PSTN 12b, 
and an international PSTN 12c. VoIP network 10 includes a gatekeeper 14 and gateways 
13a, 13b, and 13c, which are connected to gatekeeper 14, either directly or indirectly, by 
VoIP links 15a, 15b, and 15c, respectively. VoIP links 15a, 15b, and 15c use the same 
communication protocols (e.g., IP or RTP) as the Internet for transmitting digital packets. 
Gateways 13 a, 13b, and 13c are also interconnected by communication links (not shown) that 
use IP or RTP protocols. 
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Gateways 13 provide translations of protocols for call setup and release, and 
conversions of media formats between different networks. Gatekeeper 14 provides call- 
control services for end-points, such as addressing, authorization, and authentication of 
terminals and gateways; bandwidth management; accounting; billing; charging; and 
5 sometimes call-routing services. Gatekeeper 1 4 includes a routing table to route incoming 
VoIP calls to specified destinations according to destination addresses of the calls. A 
destination address can be an IP address for a computer, e.g., a PC (Personal Computer) 29 
on Internet 1 1, or a phone number for a telephone on PSTN 12a, 12b, or 12c. If an incoming 
call originates from Internet 1 1, and the destination address specifies a phone number in one 
1 0 of the PSTNs 1 2, gatekeeper 1 4 will route the incoming call to one of gateways 1 3a, 1 3b, and 

13c according to the area code or country code of the phone number. After the gateway 13 
* converts the call to analog signals, it forwards the call to the PSTN 12 specified by the phone 
18 number. Each of the PSTNs 12 respectively includes a PSTN switch 19a, 19b or 19c for 
j\ switching calls within its network to reach specified destinations. 

;3 5 If an incoming call is from one of the PSTNs 12, and the destination address specifies 

uf an IP address of a computer, e.g., PC 29, on Internet 11, gatekeeper 14 will route the call to 
j 3 an appropriate routing node (not shown) on Internet 1 1 . In this scenario, signals received by 
;q gatekeeper 14 have already been converted to digital by one of gateways 13a, 13b, and 13c. 
,f| Transmissions of voice information as described above involve a number of devices 

;f 0 that contain hardware modules or run software clients. Any problem in these hardware 
modules and software clients can impair voice quality or disrupt service of the voice 
transmissions. To ensure the QoS of the voice transmissions, a client server 20 including a 
test tool 22 is connected to PC 29, either indirectly via Internet 11 as in FIG. 1, or directly as 
shown in FIG. 2. Test tool 22 receives commands from PC 29 to perform test procedures as 
25 will be discussed in detail below. 

Referring now to FIG. 2, client server 20 also includes a memory 201 for storing 
audio files, which are data files in a digital audio format that can be played by an audio 
playing device residing on test tool 22. When commanded by a VoIP client 21 that runs on 
PC 29, test tool 22 retrieves an audio file from memory 20 1 and plays it. The audio file is 
30 played in a call placed by VoIP client 2 1 . 

In order to test the quality of voice transmissions on VoIP network 10, VoIP client 21 
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executes call initialization scripts to make a series of calls over the network. If a problem 
occurs in a transmission path, for example, degraded voice quality or persistent call 
unavailability, a diagnostic procedure can be used to identify one or more software clients or 
hardware modules among network resources that reside in the transmission path as a likely 
cause of the problem. A hardware module can be a DSP (Digital Signal Processor) chip that 
samples an analog signal into a digital format, or a filter that removes noise from the signal. 
A software client can be a system script for setting-up a connection, or an IVR (Interactive 
Voice Response) module that allows a touch-tone telephone user to interact with a database 
to access information in the database. 

For example, if calls going through a particular gateway consistently experience high 
distortions, the diagnostic procedure can direct calls to other gateways to see whether the 
distortions still exist. If the calls going through other gateways do not experience the same 
high distortions, then the particular gateway is identified as a likely cause of the distortion 
problem. 

If gateway 13b, for example, is identified as a likely cause of a network problem, 
VoIP client 21 will execute the call initiation scripts to place a series of calls through gateway 
13b to a given destination. Quality of the calls is measured at the destination. Components 
of gateway 13b, such as hardware modules, software clients, or a combination of both, that 
participate in the calls are identified. Further tests on the components, such as polling as 
described below, can be performed to pinpoint the network problem. 

When placing a call, VoIP client 21 first establishes a transmission path between the 
VoIP client 21 and destination phone 24. After the transmission path is established, VoIP 
client 21 invokes test tool 22 to play a digital audio file, e.g., a WAV file, which is stored in 
memory 201 . The WAV file uses a "*.WAV" extension, and is in a digital audio format used 
by the Microsoft Windows® Operating System (O/S). A WAV file can be used to record 
different sound qualities. Specifically, a WAV file records voice signals in either 8-bit or 16- 
bit samples at rates of 11025 Hz, 22050 Hz, or 44100 Hz. With respect to storage space, an 
exemplary WAV file with the highest quality (16-bit samples at 44100 Hz) requires about 
88KByte of storage per second. In other embodiments, other digital audio file formats may 
be utilized, as dictated by the operating system, such as Unix or Linux. 

Memory 201 stores a WAV file that includes speech patterns containing the entire 
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range of human voice, including male, female, child, and adult The WAV file can be 
incomprehensible to human ears. The speech patterns stored in the WAV file are designed to 
include voice of different pitches and intensities in order to fully exercise all features of the 
components under test. Other WAV files appropriate for the purpose of testing can also be 
used by test tool 22. 

Test tool 22 plays a WAV file each time VoIP client 21 makes a call. The WAV file is 
played in the call, and is sent to Internet 11 in the form of voice packets. In one scenario, PC 
29 subscribes to services offered by a PC-to-Phone provider's server 28 to obtain access to 
Internet 1 1 . Provider's server 28 verifies the call to see whether it comes from a registered 
PC. After the call is verified, provider's server 28 forwards the call to gatekeeper 14, which 
routes the call to gateway 13b. Gateway 13b converts the received voice packets to an 
analog audio stream, and sends the audio stream to PSTN 12b to reach a destination phone 
24, which is connected to a voice quality analyzer 25. Analyzer 25 records the received 
audio stream during the call. Once the WAV file is played in full, VoIP client 21 terminates 
the call. 

The recorded audio stream can be analyzed by analyzer 25 during the call, after the 
call is terminated, or after the series of calls are completed. Analyzer 25 measures the quality 
of the recorded audio stream using PSQM, PAMS or other quality indicators (e.g., jitter, 
packet loss rate, and noise margin). From analysis based on the measurement, analyzer 25 
can determine whether or not any software client or hardware module causes a problem in 
the voice transmissions. Results of the analysis are sent to a log file stored on client server 
20 as a call history for further detailed diagnosis. 

After VoIP client 21 completes the series of calls, test tool 22 sends a sequence of 
commands to poll software clients or hardware modules that participated the calls. The 
software clients or hardware modules return status information about their internal logics at 
the time when the calls were made. For example, a DSP chip may have a number of 
embedded circuits that collect measurements of noise level, number of packets received, or 
signal power during a call. The status information collected by test tool 22 is also stored in 
client server 20 as part of the call history for diagnostic purposes. The status information can 
be used in combination with the analysis results in the log file to generate a diagnostic report 
on the quality of one or more resources within VoIP network 10. 
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Referring to FIG. 3, a process 30 for testing voice quality of VoIP network 10 is 
shown. VoIP client 21 initially sends (3 1) a request to the destination phone 24 to establish a 
transmission path between the VoIP client 21 and destination phone 24. The request is routed 
by gatekeeper 14 and forwarded by gateway 13 to destination phone 24. After a sequence of 
5 hand-shaking occurs between the VoIP client 21 and destination phone 24, the transmission 
path is established (32). Once the transmission path is established (32), VoIP client 21 
commands (33) test tool 22 to play a WAV file, which is sent to Internet 1 1 in the form of 
voice packets. The voice packets are routed by gatekeeper 14 and then converted (34) into 
an audio stream by a gateway 13 to reach destination phone 24. 

10 When the audio stream reaches destination phone 24, analyzer 25 at the destination 

records (35) the audio stream during the call. After the WAV file is played in full, VoIP 

5 client 21 terminates (36) the call. Process 30 is repeated up to termination (36) for a 

predetermined number of times to place further calls to destination phone 24. Each time a 

s! call is placed, VoIP client 21 commands test tool 22 to play the same or a different WAV file. 




In the scenario as shown in FIG. 3, analyzer 25 analyzes (37) the recorded audio stream after 
all the calls are completed. Analyzer 25 generates analysis results based on the recorded 
stream, and sends (38) the results to a log file stored on client server 20. 



After VoIP client 21 terminates the calls, test tool 22 polls software clients or 
hardware modules that participated in process 30 to collect (39) status information. The 
status information is stored on client server 20 for determining (40) the existence and cause 
of a problem on VoIP network 10. 



Accordingly, other embodiments are within the scope of the following claims. 
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